ON MEAN DIVERGENCE MEASURES 



INDER JEET TANEJA 



Abstract. Arithmetic, geometric and harmonic means are the three classical means 
famous in the hterature. Another mean such as square-root mean is also known. In this 
paper, we have constructed divergence measures based on nonnegative differences among 
these means, and estabhshed an interesting inequahty by use of properties of Csiszdr's 
f-divergence. An improvement over this inequahty is also presented. Comparison of 
new mean divergence measures with classical divergence measures such as J- divergence 
Jensen-Shannon difference divergence measure p^ ll5j and arithmetic-geometric 
mean divergence measure ^7] are also established. 



1. Generalized Mean of Order t 



Let us consider the following well-known mean of order t 

i/t 



[1.1) Mt{a,b) = { 



\fah, t = 0, 

max{a, 6}, t = oo, 
min{a, 6}, t = — oo, 

for all a, 6 G M. 

It is also well known (ref. Beckenbach and Bellman fP) that the Mt{a,b) is monoton- 
ically non-decreasing function in relation to t. This allow us to conclude the following 
inequality 

(1.2) M_oo(a, b) ^ M_i{a, b) ^ Mo(a, b) ^ M^{a, b) ^ M^ia, b) ^ M^{a, b), 



where 



M_i(a, b) = H{a, b) = — Harmonic mean; 

a -\- b 

Mo(a, b) = G{a, b) = Vab — Geometric mean; 

Ml (a, b) = A{a, b) = ^_lL^ _ Arithmetic mean; 



and 



J' + 62 

M2(a, b) = S{a, b) = W — - — — Square root mean. 



2 

In view of this we have the following inequality. 

(1.3) H{a, b) ^ G{a, b) ^ A{a, b) ^ S{a, b). 

Recently, author improved the above inequality p.3|l . Also see Sandor [Hj for 
different kinds of inequalities among the means. 
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Let US consider now the following non-negative differences arising due to inequality 



MsA{a,b) 


= S{a, 


b) 


- A{a, 


b) 


Msg 


'a,b) 


= S{a, 


b) 


— G{a, 


b) 


MsH 


[a,b) 


= S{a, 


b) 


-H{a 


b) 


Mah 


[a,b) 


= A{a 


b) 


-H{a 




Mag 


[a,b) 


= A{a 


b) 


— G{a, 


b) 



+ 62 a + b 



a^ + b^ _ 2ab_ 
2 a + b' 
a + b 2ab 



2 a + b' 
a + b 



and 



ab 



MGH{a,b) = G{a,b) - H{a,b) = Vab 



a + b 

In view of f)1.2j) . we have the following inequalities among then mean difference mea- 
sures: 

(1.4) < MsA{a, b) ^ MsG{a, b) < Msnia, b) 
and 

(1.5) Q^^MagM^MahM. 



2. Mean Difference Divergence Measures 



Let 



P = {Pl,P2, ■■■,Pv 



i=l 



be the set of all complete finite discrete probability distributions. 

Let us take a = pi and 6 = in the differences given above and sum over alH = 1, 2, .., n, 
then for all P, Q € r„, we have the following mean divergence measures: 

• Square root - arithmetic mean divergence 



2 2 

Msa{P\\Q) = Y.\I^^-^- 

i=l 

Square root - geometric mean divergence 



Msg{P\\Q) = E - VMl 

Square root - harmonic mean divergence 



Msh{P\\Q) = Y1 



i=l 



Pi + Qi '^PtQi 



Pi + Qi 
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Arithmetic — geometric mean divergence 

n 

MAG{P\\Q) = i-Y.Vml- 



1=1 



Arithmetic — harmonic mean divergence 



Mah{P\\Q) = 1-Y. 



• Geometric — harmonic mean divergence 

MoHiPWQ) = E [VM^-^J = E — ■ 

After simplification, we can write 

1 " 

Mag{P\\Q) = 1 - B{P\ \Q) = h{P\ |g) = - E (v^ - v^)'. 

i=l 

where B{P\\Q) is the Bhattacharyya j2] distance and h{P\\Q) is the well known Hellinger 
jH] discrimination. 
Also we can write 

Mj,h{P\\Q) = 1 - W{P\\Q) = \hP\\Q) = E ^I^T^' 

where VF(P||Q) is the harmonic mean divergence and A(P||(5) is the well known trian- 
gular discrimination. 

Some studies on square root - arithmetic mean divergence can be seen in Osterreicher 
and Vajda [13] and Dragomir et al. |HI. 

In view of (|1.4j) and (|1.5|) . we have the following inequalities 

(2.1) ^ Msa{P\\Q) ^ Msg{P\\Q) ^ Msh{P\\Q) 
and 

(2.2) O^MP||Q)^^A(P||Q). 

In this paper our aim is to obtain an inequality relating the mean divergence measures 
given above. This shall be done by use of Csiszdr's f — divergence. 

3. Csiszar's /-Divergence and Mean Divergence Measures 

Given a convex function / : (0, oo) M, the f— divergence measure introduced by 
Csiszar [4^ is given by 

(3.1) Cf{P\\Q) = j2Q^f(T-)^ 

i=i vyi/ 

for all P,Q eVn. 

The following theorem is well known in the literature [UEj: 
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Property 3.1. Let the function f : [0, oo) —>■ M. be differentiable convex and normalized, 
i.e., /(I) = 0, then the Csiszdr f— divergence, Cf{P\\Q) is nonnegative and convex in the 
pair of probability distribution {P,Q) G r„ x r„. 

The mean divergence measures given in Section 2 can be written as examples of ()3.ip 
and applying propertv lH.ll we can check the nonnegativity and convexity of these measures. 
Here below we shall give these as examples. 

Example 3.1. Let us consider 



fsA^x) = y — X G (0, cx)), 

m / TO) , then we have Cf{P\\Q) = MsAiP\\Q)- 
Moreover, 

and 



Thus we have f'sAi^) > for all x G (0, oo). Also, we have fsA{^) = 0. In view of this 
we can say that the square root - geometric mean divergence is nonnegative and convex 
in the pair of probability distributions {P,Q) G r„ x r„. 

Example 3.2. Let us consider 



fscix) = \l y^, X e (0, CX)), 



m / TO) , then we have Cf{P\\Q) = Msg{P\\Q)- 
Moreover, 



X 



- - 



and 



V2(x2 + l)^/x^~p[ AXy/x' 

Thus we have fscix) > for all x G (0, oo). Also, we have /sg(1) = 0. In view of this 
we can say that the square root - geometric mean divergence is nonnegative and convex 
in the pair of probability distributions {P,Q) G r„ x r„ . 

Example 3.3. Let us consider 



in / TO) , then we have Cf{P\\Q) = Msh{P\\Q)- 
Moreover, 



2 ■ 



and 



727^2^ (a; + 1) 



'^^^"^ V^(x + l)2v/^^" (X+1)3- 

Thus we have f'snix) > for all x G (0, oo). Also, we have fsni^) = 0. In view of this 
we can say that the square root - geometric mean divergence is nonnegative and convex 
in the pair of probability distributions {P,Q) G r„ x r„. 
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Example 3.4. Let us consider 



fh{x) = ^{V^-lf, xe (0,oo) 



in / TO) , then we have Cf{P\\Q) = h{P\\Q). 
Moreover, 



and 



ax) 



Thus we have fj[{x) > for all x G (0, oo). Also, we have = 0. In view of this 

we can say that the square root - geometric mean divergence is nonnegative and convex 
in the pair of probability distributions {P,Q) G x F^. 



Example 3.5. Let us consider 



(x - 1)^ 

fA{x) = — ^, X G (0,oo), 

X + 1 



in JO) , then we have Cf{P\\Q) = A{P\\Q). 
Moreover, 



(x-l){x + 3) 



and 

flix) ^ 



Thus we have f'^{x) > for all x G (0, oo). Also, we have /a(1) = 0. In view of this 
we can say that the square root - geometric mean divergence is nonnegative and convex 
in the pair of probability distributions {P,Q) G F„ x F„. 



4. Bounds on Mean Divergence Measures 

In this section we shall give bounds on the measures given in Section 2. In order to 
get these bounds we shall make use of the properties of Csiszdr's f-divergence due to 
Dragomir [H]. 

Property 4.1. Let f : ]R_|_ ^ M &e differentiable convex and normalized i.e., /(I) = 0. // 
P,Q EVn, then we have 

(4.1) Q^Cf{P\\Q)^Ec,{P\\Q). 
where 

n 

, KPi - 

i=l 



EcAP\\Q) = Y.^P^-q^)rO■ 

Hi 
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4.1. Square root — arithmetic mean divergence. We have 

O^Msa{P\\Q)^Esa{P\\Q), 

where 

n / 

Pi 



EsA{P\\Q)=J2{p^-q^ 



i=l 



V2W + qf) 



PI - PiQi + Qt - QI 

r vm + it) 



Msa{P\\Q) + 1-Y1 



qi{pi + Qi 



Msa{P\\Q) + Y.q^ 



V^ip- + qf) - {Pi + qi 



i=l 



with 



^sa{P\\Q) = Y1 



MsAiP\\Q)+^SA{P\\Q) 

V2q^ 



pf + qt Pi + qi 



i=i VpI + (if 

In view of fl4.ip . we can say that ^sa{P\\Q) ^ 0. 

4.2. Square root — geometric mean divergence. We have 

O^Msg{P\\Q)^Esg{P\\Q), 

where 

Pi vqi 

VP. - 77^ 

i=l 



EsGiP\\Q) = J2^P^-1^) 



%p1 + qf) 



^ ( - Piqi + qf - qf \/qi{Pi-q. 



i=l 



s/qiiPi + qi) qt{Pt + qi 



(Pi + qi 



i=i ^VPiVPi + 5i 

MsG(P||g)+e5G(P||Q), 



+ - v^2^ 



with 



2 = 1 



+ qf 



VPi^i]- 



In view of M.lj) . we can say that ^5g(-P||<5) ^ 0. 
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4.3. Square root — harmonic mean divergence. We have 

O^Msh{P\\Q)^Esh{P\\Q), 

where 

2gf 



Esh{p\\Q) = J2(p^-i 



Pi 



K - PiQi + ?i - QI '^QliVi - * 



A# ^p||^^ I ^ ( '^PMPi + g») - 2g- fa - gi) 9»fa + qi 



A/sh(^'II«)+5]<(. 



2(r' + qf) {Pi + qi) 



MsHiP\\Q) + J2qi 



i=l 



(p^ + v^w+Ti 

(V^ipl + qf)) -{Pi + qi 



{pi + qi)W'^ipl + ql 



MsHiP\\Q)+^SHiP\\Q), 



with 



^sh{P\\Q) = Y.<1^ 



i=l 



v/2faT 



{Pi + qi 



{p^ + qi)W^ipHq! 

In view of fl4.ip . we can say that C,sh{P\\Q) ^ 0. 

4.4. Hellinger discrimination. We have 

O^M^{P\\Q)^EhiP\\Q), 



where 



i=l 



E 



^VPi 

{Vp^.- VqlY iVPi + V^) 



i=l 



1 . I — " 

M.(P||g) + -5^.p(v^-v/^) 

^ i=l V Pi 

Mf,{P\\Q) + UP\\Q), 



with 



1 " I — ~ 



Obviously, ^h{P\\Q)>0. 
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4.5. Triangular discrimination. We have 

O^M^{P\\Q)^E^{P\\Q), 



where 



2 



A(P||Q) + 2 5^g, 

i=l 

Ma{p\\Q) + U{p\\Q) 



Pi - Qi 



Pi + Qi 



with 



2 

Pi- qi' 



Pi + Qi 



eA(P||Q) = 2 5^g. 

i=l 

Obviously, U{.P\\Q) > 0. 

5. Inequalities among Mean Divergence Measures 
In this section we shall obtain inequalities among the measures given in Section 2. 

Property 5.1. Let /i,/2 : / C M+ ^ he two convex mappings that are normalized, 
i.e., /i(l) = /2(1) = and suppose the assumptions: 

(i) fi and f2 are twice differentiable on {a,b); 

(a) there exists the real constants a,P such that a < [3 and 

(5.1) a ^ ^ n{x) > 0, Vx e (a, 6). 
Then, 

(5.2) a Cf,{P\\Q) ^ CfAPWQ) < P Cf,{P\\Q), 
and 

(5.3) a[Ef,{P\\Q)-Cf,{P\\Q)]^Ef,{P\\Q)-CfAP\\Q) 

^P[Ef,{P\\Q)-Cf,{P\\Q)] 

Proof. Let us consider the functions 

(5.4) pa{x) = fi{x) - a fiix) 
and 

(5.5) pp{x)=PUx)-Mx), 

where a and P are as given by ()5.1|) . 

Since fi{x) and f2{x) are normalized, i.e., /i(l) = /2(1) = 0, then Pa(l) = P/3{1) = 0. 
Also, the functions fi{x) and f2{x) are twice differentiable. Then in view of ()5.H) . we 
have 



(5.6) pM = f;{x) - a f^ix) = f^ix) (|M _ « ) ^ 



and 



(5.7) p';,{x) = (3f^{x) - n{x) = f^{x) 1/5-^)^0, 



for all X G (a, b). 
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In view of (j5.6p and (j5.7|) . we can say that the functions Pa(') and p^{-) are convex on 
(a, 6). 

According to Propertv 13.11 we have 

(5.8) C,^{P\\Q) = C;,-./,(P||g) = Cf,iP\\Q) - a Cf,{P\\Q) ^ 0, 
and 

(5.9) C,^{P\\Q) = CfSf,.f,{P\\Q) = p Cf,AP\\Q) - CfAPWQ) ^ 0. 
Combining ()5.8p and ()5.9|) we have the proof of ()5.2|) . 

Now, we shall prove the inequalities (j5.3p . We have seen above that the real mappings 
Pa{-) and P/3(-) defined over M+ are normalized, twice differentiable and convex on {a,b). 
Applying the r.h.s. of the inequalities (|5.2j) . we have 

(5.10) C,^{P\\Q) ^ Ec,jP\\Q) 
and 

(5.11) C,^{P\\Q)^Ec,^iP\\Q). 
Moreover, 

(5.12) C,^{P\\Q) = Cf,{P\\Q) - a Cj,{P\\Q) 
and 

(5.13) C,^ {P\\Q) = f3 Cf, {P\\Q) - Cf, {P\\Q). 
In view of (|5.1(jp and (|5.12j) . we have 

CfAPWQ) - « Cf,{P\\Q) ^ Ec^,_^, {P\\Q) 

= Ef,\p\\Q)-aEj,{P\\Q). 

This gives, 

a [Ec,^{P\\Q) - Cf,{P\\q^ ^ Ec,^{P\\Q) - C/,(P||g). 

Thus, we have the l.h.s. of the inequalities ()5.3p . 
Again in view of ()5.11|) and ()5.13|) . we have 

/? C/,(p||g) - C/,(p||g) ^ Ec,,^_^^ (P||g) 

= i5Y.^^{P\\Q)-Ec,^{P\\Q). 

After simplifying, we get 

Ef, [P\\Q) - Cf, (P| \Q) ^ (5 (P| |g) - Cf, (P| m . 

Thus we have the r.h.s. of the inequalities ()5.3p . This completes the proof of the 
property. □ 

Now, we shall apply the above theorem for the measures given in Section 2. 

Theorem 5.1. The following inequalities among the mean difference and auxiliary diver- 
gences hold: 

(5.14) Msa{P\\Q) ^ Imsh{P\\Q) < ^A(P||g) ^ ^Msg{P\\Q) < h{P\\Q), 
and 

(5.15) ^sa{P\\Q) ^ lisH{P\\Q) < \UP\\Q) < 1^sg{p\\Q) < UP\\Q)- 
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The proof is based on the following propositions. 
Proposition 5.1. The following inequalities hold: 

(5.16) ^ Msa{P\\Q) < ^Msh{P\\Q), 
and 

(5.17) O^^SAiP\\Q)^l^sHiP\\Q) . 
Proof. Let us consider 



This gives 
(5.18) 9'sA.SHi^) 



24(x-l)(x2 + l)(x + l)2 f ^0, x^l 

^0, x>l 



V/2(X2 + 1) [{X + 1)3 + 4^2(^2 + 1)3/2] • 

In view of ()5.18|) we conclude that the function gsA.SH{x) increasing in x G (0, 1) and 
decreasing in x G (1, oo), and hence 

(5.19) (3 = sup gsA.sH{x) = gsA.sni'^) = \- 

Now ()5.19|) together with ()5.2|) and ()5.3p give respectively ()5.16|) and ()5.17|) . □ 
Proposition 5.2. The following inequalities hold: 

(5.20) Of^MsA{P\\Q)^\A{P\\Q), 
and 

(5.21) 0^^sAiP\\Q)<\uiP\\Q)- 

Proof. Let us consider 

gsA A a; = / = — -, X G 0, oo), 

f'L{x) 8V^(x2 + 1)3/2' ^ ^' 

This gives 

(5.22) ^?,^_^(x) - g^(^2 + 1)5/2 1^0, X ^ 1 • 

In view of (I5.22j) . we conclude that the function 5'5A.A(a;) is increasing in a; G (0, 1) and 
decreasing in x G (1, oo), and hence 

(5.23) M= sup gsA.A{x) = gsA.A{l) = 

x6(0,oo) 4 

Now (jOHIl together with dOJ and ((HISI) give respectively (jOHIl and ([CT]) . □ 
Proposition 5.3. The following inequalities hold: 

(5.24) O^^A{P\\Q)^MsGiP\\Q) , 
and 

(5.25) 0^^eA(^||Q)^e5G(P||Q). 
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Proof. Let us consider 

*°-(^' = TXW = 32V2 (x^ + • - ^ (»■ 

This gives 

3(s + - 1) [^2 (a;2 + 1)^/' - 8x^/2^ 
(5.26) g'scA^) = 



Since + 1 ^ 2x, then from we conclude that 



(5.27) g'scA^) 



^0, x^l 
^0, xCl 



In view of fl5.27j) . we conclude that the function gsG.A{x) is decreasing in x G (0, 1) and 
increasing in x G (1, cxo), and hence 

(5.28) a = inf 5^50^(2;) = min gsG^x) = J. 

x6(0,oo) xG(0,oo) Z 

Now (IH:^ together with (Q and (Q give respectively (IH:^ and (jElSl)- □ 
Proposition 5.4. VFe /iawe the following bounds: 

(5.29) 0^M5G(P||g)^2/i(P||g), 
and 

(5.30) 0^^5G(P||Q)^2a(^'IIQ)- 
Proof. Let us consider 

, , /^'g(x) 4x^/2 + (x2 + 1)3/2 

ySGMK J j,,^^^ ^2 (a;2 + 1)3/2 ^ ' ^ 

This gives 

, 6(x-l)(x+l)Vi f ^0, x^l 

^ ^ ^ - y2(x2 + 1)5/2 \ ^ 0, X ^ 1 ■ 

In view of fl5.31|) . we conclude that the function gsG.h{x) is increasing in x G (0, 1) and 
decreasing in x G (1, 00), and hence 

(5.32) (3 = sup gsGA^) = 9sgA^) = 2- 

xe(o,oo) 

Now ^^n^ together with (Q and (Q give respectively (IK:^ and □ 

The inequalities (IKTTHll . (IK^ . (IH^ and together give ^TWi and the inequalities 

()5.17|) . ()5.21|) . ()5.25|) and ()5.30|) together give ()5.15|) . This completes the proof of the 
Theorem 15.11 

Remark 5.1. (i) The divergence measure arising due to geometric-harmonic mean 
is not studied here because it is not convex. 



(ii) The auxiliary measures C,{.){P\\Q) can be written in terms of Csiszdr f-divergence, 
but they are not necessarily convex. 
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6. Comparison with Classical Divergence Measures 

In this section, we shall present some classical divergence measures. The following 
Jensen-Shannon divergence measure |Sl 11^1 is already known in the literature: 

n 

(6.1) IiP\\Q) = J^t^bilii^'^'^^lngi) - A(p„gi)lnA(pi,gi)]. 

1=1 

Taneja J7j presented the following arithmetic and geometric divergence measure arising 
due to arithmetic and geometric means: 

(6.2) r(P||Q)^|:^fe,,,),ni|||l. 

Adding dHUl) and (Q, we get 

(6.3) IiP\\Q)+T{P\\Q)=AJ{P\\Q), 

where J{P\\Q) is the well known Jefferys-KuUback-Leibler [Ullini J-divergence given by 

(6.4) J ^p\\Q) = J2 (p. -q.) In (^). 

i=i V^*/ 

For more studies on the measures (j6.2j) - (j6.4|) with their generalizations and some statis- 
tical applications refer to Taneja |16j il8j |21jn22j . For new symmetric divergence measure 



refer to Kumar and Chhina ^2] 

Recently, author |19| 120] proved an inequality among these divergence measures given 

by 

(6.5) Ia{P\\Q) ^ I{P\\Q) ^ h{P\\Q) ^ h{P\\Q) ^ TiPWQ). 

Finally, combining the inequalities ()5.14|) and ()6.5|) . we have the following interesting 
inequalities: 

(6.6) Msa{P\\Q) < Imsh{P\\Q) K \a{P\\Q) ^ hlsG{P\\Q) 

^hiP\\Q)^yiP\\Q)^ TiPWQ), 

and 

(6.7) Msa{P\ \Q) ^ Imsh{P\ \Q) < \a{P\ \Q) ^ I{P\\Q) 

<:h{P\\Q)<:^J{P\\Q)^T{P\\Q). 

From the inequalities ()5.14|) . ()6.6p and ()6.7|) . we observe that we don't have relation 
among the measures SG-divergence and I-divergence. Let us check this by applying 
Property 15.11 

Let us consider 

fi{x) = - In X + In ( 1 , a; e (0, oo) 

in (jnU, the one gets Cf{P\\Q) = I{P\\Q). 
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Moreover, 



and 



fiix) - 



In 



2x 



X 



Again, let us consider 



2x{x + 1) 
[4a;3/2 + 72 (a;2 + 1)3/2] ^ 

+ l)3/2a;3/2 ^ 

The first order derivative of the function gsGj{x) is given by 

{x — l)o'{x) 



9SGJ[X) 



X G (0, 00). 



9sGji^) 



4:V2ix^ + lf\^/^' 



where 



a{x) = V2{x' + 1)'/' - 8x'/^ {x^ + 3x + 1) 



In order to apply Propertv 15.11 we must prove that a{x) is either negative or positive 
for X G (0,00), but cr(l) = —32.0 and cr(4.25) = 13.87. This implies that we are unable 
to apply the Property 15.11 

Moreover, if we check the generating functions in both the cases, still the result don't 
hold. Let us denote, a(x) = fsA^x), h{x) = Ifsnix), c{x) = ifA^x), d{x) = ^scix), 
e{x) = fi{x) and f{x) = fh{x) for all x G (0, 00). Then we have the following values of 
these two functions: 



X 


0.1 


10 


1000 


3000 


3800 


3900 


a{x) 


0.1606 


1.6063 


206.6071 


620.8204 


786.5058 


807.2165 


b{x) 


0.1762 


1.7627 


235.0363 


706.4403 


895.0021 


918.5723 


c(x) 


0.1840 


1.8409 


249.2509 


749.2503 


949.2502 


974.2502 


d{x) 


0.1972 


1.9720 


337.7421 


1033.2741 


1312.6808 


1347.6332 


e{x) 


0.2136 


2.1368 


342.9660 


1035.5640 


1312.7047 


1347.3491 


fix) 


0.2337 


2.3377 


468.8772 


1445.7277 


1838.8558 


1888.0500 



We observe from the above table that the values of d{x) and e{x) changes in the interval 
X G [3800,3900], before it d{x) is always smaller than e{x). 

Let check the same thing by considering particular values of the probability distribu- 
tions. Let us consider n = 2, pi = t, qi = 1 — t, p2 = I — t and q2 = t. Then we can 
write 



a{t) = Msa{P\\Q) = 2xr^±^^^-^ - 1, 



c{t) = \/\{P\\Q) = \{2t-l)\ 



dit) = -Msg{p\\Q) = \l \ ' - V^O^, 

e(t) = I{P\\Q)=t ln(2t) + (1 - t) log(2 - 2t) 
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and 

f(t) = h{P\\Q)=(^Vi-Vr~ty 
for all t G [0, 1] with the convention that OlogO = 0. 



Let us compare the measures for some particular values of t. 



t 


0.0001 


0.001 


0.01 


0.1 


0.2 


0.4 


a{t) 


0.4140 


0.4128 


0.4001 


0.2806 


0.1662 


0.01980 


m 


0.4712 


0.4696 


0.4535 


0.3068 


0.1754 


0.01993 


c{t) 


0.4998 


0.4980 


0.4802 


0.3200 


0.1800 


0.02000 


d{t) 


0.6970 


0.6747 


0.6005 


0.3403 


0.1830 


0.02004 


eit) 


0.6921 


0.6852 


0.6371 


0.3680 


0.1927 


0.02013 


fit) 


0.9800 


0.9367 


0.8010 


0.4000 


0.2000 


0.02020 



Here we have considered only the values of t G (0, 1/2], since for t G [1/2, 1) the values 
are symmetric. Moreover, all values are zero for t = \- From the table we observe that for 
each t fixed the values of the functions are monotonically increasing, except for t = 0.0001, 
d(t) is bigger than e{t). 

From the example above we conclude that we are unable to establish an inequality 
having nine measures in a sequence combining ()6.6|) and ()6.7j) . 

7. Refinement Inequalities 

Now we shall improve the inequality ()5.14|) . In order to do so, we shall again consider 
the following non-negative differences: 

Df^{P\\Q) = f2 Q^fk {-\k= 1, 2, 10, 
i=i ^^'^ 

where , for all x G (0, oo), we have 



fl 




= fAcix) - 


^fscix), 






= fAcix) - 


^fAH{x), 


h 




= fAoix) - 


^fsH{x), 


h 




= fAcix) - 


fsA{x), 


h 




= ^fscix) 


- ^fAH{x), 


h 




= ^fscix) 


- ^fsH{x), 


fl 




= ^fscix) 


- fsAix), 


fs 




= ^fAH{x) 


- ^fsnix), 


/9 




= ^fAH{x) 


- fsA{x), 
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and 



/io(a;) = ^fsnix) - fsA{x). 



We can easily verify that 



(7.1) /,(x) = i/4(x) = /7(x), 
and 

(7.2) fs{x) = i/9(x) = iAo(x). 
For all X G (0, oo), we can write 

/5 (^) = ^^^^V^ - - ^^q^ = ^ + ^ - (^ + G*)] , 



and 



v/2(x2 


+ 1) 


2 


V2(a:2 


+ 1) 



fJx) = ^"^"^ ' - + — = i [5 + 2i7 - 3G] 
•'^^ ' 12 2 3(a; + 1) 6 ^ ^ 



(x - 1)^ v/2(x^ + l) , 2x 1 ..c^^mi 

= 6 + WTT) = 6 - + 



where A = G = a/x, H = and S = y are respectively arithmetic, geometric, 
harmonic and square-root means between x and 1. 

Theorem 7.1. T/ie following inequality among the new differences hold: 

(7.3) Df,{P\\Q) < ^%(P||g)i ^ \Df,iP\\Q) ^ lDf,iP\\Q) ^ D/,(P||Q). 

Proof. We shall prove each part of the inequality separately. These inequalities can be 
proved on similar lines of theorem 15. H but here we shall give a simpler proof. 



(i) We can write 

'fA + H\ 



fe{x)-\f2{x) = l[S + 2H-3G]-\ 
3d 3 



V 2 / 



G 



= hs + H-{A + G)] = \f,{x) ^ 0, Vx G (0, oo) 
3 

This prove that |/2(x) ^ f&{x), Vx G (0, oo), and consequently, we get 
(7.4) \D}AP\\Q)^Df,{P\\Q). 
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(ii) We can write 



A + H 



G 



12 



[^A + H-{S + SG)] 



L[S + H-{A + G)] = \h{x) ^ 0, Va: G (0, 00) 



This prove that \fz{x) ^ |/2(x), Vx e (0, 00), and consequently, we get 
(7.5) 

fiii) We can write 

11 1 r 

A 



\d^,{p\\q)^\d^,{p\\q). 



G + S 



l[3A + iJ-(5 + 3G)]-^ 
^[S + H-{A + G)] = \h{x) ^ 0, Va; e (0, 00) 



This prove that \fi{x) ^ \f?,{.x), Vx G (0, 00), and consequently, we get 
(7.6) 

(iv) We can write 



\Dj,{P\\Q)^\Df,{P\\Q). 



3 [ V 2 / 6 

]:[S + H~{A + G)] = J/5(x) ^ 0, Vx G (0, 00) 
o 3 



[3A - (25 + H)] 
1 



This prove that fs{x) ^ \fi{x), Vx G (0, 00), and consequently, we get 



(7.7) 



Df,iP\\Q)^-Df,iP\\Q). 



Combining ()7.4p - ()7.7|) we get the required result. 



□ 



Remark 7.1. (i) Simplifying the inequalities given ^7.^ and using the nonnegativity 
of the expression f^{x), Vx G (0, 00), we get the following improvement over the 
inequalities \5.1Ji\} : 

(7.8) Mgh{P\\Q) ^ Msa{P\\Q) ^ \msh{P\\Q) ^ \hP\\Q) 

^ 3A(P||g) + 2MsG(P||Q) ^ h{P\\Q) + ?,MsA{P\\Q) 
^ 16 ^ 4 

^ h{P\\Q)+MsH{P\\Q) ^ 6M5G(P||g) + A(P||Q) 

^\msg{P\\Q) ^h{P\\Q) ^]^/\{P\\Q) 

We observe that the measure Mgh{P\ \Q) in not convex in the pair of probability 
distributions, but even then we are able to relate it in the above inequalities. 
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(ii) Recently, author |20j also gave an improvement over the inequality id. 5)) ; 
(7.9) \a{P\\Q) ^ I{P\\Q) ^ h{P\\Q) + ^A{P\\Q) ^ hiP\\Q) 

^ ^APWQ) + IhpWQ) ^ InPWQ) + hiPWQ) 

K Ij{P\\Q) < InPWQ) + ^A{P\\Q) ^ T{P\\Q). 
The above inequality also improves the one studied by Dragomir et al. [Zj. 

References 

[1] E.F. BECKENBACH and R. BELLMAN, Inequalities, Springer- Verlag, New York, 1971. 

[2] A. BH ATTACH ARYYA, Some Analogues to the Amount of Information and Their uses in Statistical 
Estimation, Sankhya, 8(1946), 1-14. 

[3] J. BURBEA and C.R. RAO, On the Convexity of Some Divergence Measures Based on Entropy 
Functions, IEEE Trans, on Inform. Theory, IT-28(1982), 489-495. 

[4] L CSISZAR, Information Type Measures of Differences of Probabihty Distribution and Indirect 
Observations, Studia Math. Hungarica, 2(1967), 299-318. 

[5] I. CSISZAR, On Topological Properties of /—Divergences, Studia Math. Hungarica, 2(1967), 329- 
339. 

[6] S. S. DRAGOMIR, Some Inequalities for the Csiszar ^-Divergence - Inequalities for 
Csiszdr f-Divergence in Information Theory - Monograph - Chapter I - Article 1 - 
http://rgmia.vu.edu.au/monographs/csiszar.htm. 

[7] S. S. DRAGOMIR, J. SUNDE and C. BUSE, New inequahties for Jeffreys divergence measure, 
Tamsui Oxford Journal of Mathematical Sciences, 16(2)(2000), 295-309. 

[8] S. S. DRAGOMIR, V. GLUSCEVIC and C.E.M. PEARCE, New Approximations for /-Divergence 
via Trapezoid and Midpoint Inequalities http://rgmia.vu.edu.au, RGMIA Research Report Collec- 
tion, 5 (4) (2002), Article 14. 

[9] E. HELLINGER, Neue Begriindung der Theorie der quadratischen Formen von unendlichen vielen 
Veranderlichen, J. Reine Aug. Math., 136(1909), 210-271. 

[10] H. JEFFREYS, An Invariant Form for the Prior Probability in Estimation Problems, Proc. Roy. 
Soc. Lon., Ser. A, 186(1946), 453-461. 

[11] S. KULLBACK and R.A. LEIBLER, On Information and Sufficiency, Ann. Math. Statist, 22(1951), 
79-86. 

[12] P. KUMAR and S.A. CHHINA, A Symmetric Information Divergence Measure of Csiszr's 
/—Divergence Class and its Bounds, Computer and Mathematics with Applications, 49(4) (2005), 
575-588. 

[13] F. OSTERREICHER and I. VAJDA, A New Class of Metric Divergences on Probabihty Spaces and 
its Applicability in Statistics, Ann. Inst. Statist. Math., 55(3)(2003), 639-653. 

[14] J. SANDOR, On Certain Inequalities for Means - II, J. Math. Analy. and Appl., 199(1996), 629-634. 

[15] R. SIBSON, Information Radius, Z. Wahrs. und verw Ceb., (14)(1969), 149-160. 

[16] I.J. TANEJA, On Generalized Information Measures and Their Applications, Chapter in: Advances 
in Electronics and Electron Physics, Ed. P.W. Hawkes, Academic Press, 76(1989), 327-413. 

[17] I.J. TANEJA, New Developments in Generalized Information Measures, Chapter in: Advances in 
Imaging and Electron Physics, Ed. P.W. Hawkes, 91(1995), 37-136. 

[18] I.J. TANEJA, Ceneralized Information Measures and their Applications - On-line book: 
http://www.mtm.uf sc.hr /^taneja/hook/hook.html, 2001. 



18 



INDER JEET TANEJA 



[19] I.J. TANEJA, Generalized Symmetric Divergence Measures and Inequalities - RGMIA Re- 
search Report Collection, http://rgmia.vu.edu.at4 7(4) (2004), Art. 9. Available on-line at: 



arXiv:math.ST/0501301| vl 19 Jan 2005. 

[20] I.J. TANEJA, Refinement Inequalities Among Symmetric Divergence Measures The Australian 
Journal oj Mathematical Analysis and Applications, 2(1)(2005), Art. 8, pp. 1-23. Available on-line 
at: |arXiv:matIi.PR/0501303| vl 19 Jan 2005. 

[21] I.J. TANEJA, Generalized Arithmetic and Geometric Mean Divergence Measures and Their Sta- 
tistical Aspects - To appear in Journal of Interdisciplinary Mathematics. Available on-line at: 
[arXiv:math.PR/0501297 vl 19 Jan 2005. 

[22] I.J. TANEJA, Bounds on Triangular Discrimination, Harmonic Mean and Symmetric Chi-Square 
Divergences - To appear in Journal of Concrete and Applicable Mathematics. Available on-line at: 
|arXiv:math.PR/0505238 vl 12 May 2005. 

[23] I.J. TANEJA, Refinement Inequalities Among Means - Available on-line at: arXiv:math. 
GM/0505192 vl 10 May 2005. 

Departamento de Matematica, Universidade Federal de Santa Catarina, 88.040-900 
Florianopolis, SC, Brazil 

E-mail address: taneja@nitni.ufsc.br 
URL: http : / / www . mtm . uf sc. br/~tane j a 



